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Abstract 


Communication between human beings is mediated not only through verbal 
language: facial expressions, body gestures and intonational qualities of the 
voice all contribute to transmitting social cues, emphasizing or clarifying the 
verbal message, and communicating one's emotional state. To determine which 
brain structures might be critical for processing such information, subjects 
having either unilateral lesions or commissurotomy were given the PONS test, a 
standardized scale which assesses competence in decoding paralinguistic cues. 
Our results indicate that overall sensitivity to nonverbal communication is more 
reliant upon structures the right cerebral hemisphere than the left, and is thus 
processed on the opposite side of the brain from verbal language. The right 
hemisphere appears to be particularly critical for evaluating facial 


expressions, the most salient channel of emotional communication. 
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Discoveries in neurology and linguistics indicate that many aspects of human 
language are determined by specific structural features of the brain, a notion 
which differs radically from the more prevalent idea of language being an | 
arbitrary, culturally evolved set of symbols and combinatorial rules which during 
development somehow become represented upon, infinitely malleable nervous system. 
The present study has attempted to examine whether such neurological 
specification might extend to other aspects of our social interactions as well, 
particularly the communication of affect through paralinguistic cues. But before 
describing the rationale for our own studies, it might be best to mention a 
little more about spoken language. | 

Through postmortem studies of people who, during their lives had lost 
linguistic fluency after stroke, the French neurologist Paul Broca discovered 
that it was the left inferior precentral cortex whose destruction caused speech 
production to be very labored, with most grammatical elements omitted. In this 
disorder, now commonly known as Broca's aphasia, the principal content words 
remain appropriate but are produced with difficulty. Full sentences are seldom 
used, and surprisingly, reading or repetition of text material follows the same 
pattern. Singing remains intact, however, showing that the dysfunction is not 
general to all vocal control. Rather, it has been postulated that Broca's area 
is involved in transforming intentions or ideas into spoken utterances according 
to the appropriate grammatical rules.+ A few years after Broca's discovery, the 
German neurologist Carl Wernicke found that damage to another portion of the left 


hemisphere, adjacent to the primary auditory area in the temporal lobe, is 


. associated with a disorder in which speech production is fluent but often makes 





json ditere sense. Nonsensical words are included, incorrect syllables are 
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substituted in otherwise correct words, and ideation is sometimes aberrant. 
_Grammatical form is intact, however, and even the inappropriate words take on a 
syntactic form suitable to their place in the sentence. Phrase length and melody 
of speech are preserved, so that someone not familiar with the language being 
spoken would have the impression that all is normal. Comprehension of spoken or 
written language is likewise impaired, and it is believed that Wernicke's area 
may play a role in processing semantic and.ideational aspects of language. Other 
types of language disorders, including selective losses in reading, repetition, 
and naming, have likewise been associated with the loss of particular left brain 
regions, supporting the idea that human language is inexorably related to 
specific anatomical features of the brain. Moreover, recent studies now indicate 


that portions of the posterior temporal cortex, which includes the Wernicke's 








area, are asymmetric between the two sides of the brain at birth. Thus, it may 
be the case that the neurology may even prefigure where and how language becomes 
represented in the brain, or, in other words, our linguistic abilities may 
actually be the product of highly specialized, predetermined circuits in the 
brain. A similar conclusion has been reached by linguists impressed with the 
many stereotyped features of language development in the child and with the 
universality of formal aspects of syntax.2?/ Language develops without the child 
needing any explicit instruction as to rules of phenome production or syntax, a 
phenomenon which Chomsky? has argued can only come about by linguistic competence 
being predetermined by the neurology of the human brain. Chomsky has also argued 
that other domains of human cognition which are similarly acquired spontaneously 
in childhood and which are universal in their manifestation must likewise reflect 
well-defined neural determinants. One faculty which may be of this nature would 
be the ability to evaluate the significance of paralinguistic cues in 
communication. | 

As demonstrated in numerous studies, a great deal of the information which is 
exchanged in human interactions is not contained in the words alone as they would 
appear in a written text: facial expressions, body movements and intonational 
qualities of the voice all serve to structure and qualify the verbal message, 
influence the social relationship between speaker and listener, and convey 
information about one's emotional state.77° The thesis that competence in 
evaluating these cues may be specified by our biological inheritance was first 
put forth in 1872 by Charles Darwin. "The Expression of the Emotions in Man and 
Animals," presents a series of observations, arguments, and proposals for further 
research which stand today as the most thorough analysis of the biology of 
affective communication. Darwin was particularly impressed with the observation 
that the facial expressions that appear during such states as anger, disgust, and 
pleasure appear in infancy and are universal to all cultures. He carefully 
analyzed the groups of facial muscles involved in the formation of these 
expressions, then reasoned how such activational patterns might have selectively 
come to be Nhard-wired" because of their functional advantages in our 
evolutionary past. And while their actual utility would have long since 
disappeared, the patterns of expression may have been retained for their 
communicative value. However, for this to be of any significance, not only the 
expressive capacity, but also the ability to perceive the significance of these 
signals would need to be specified biologically. By analogy with spoken 


language, where some 2000 distinct tongues exist and where almost no words are 


universal, the issue is not whether the particular signals used are common, but 
whether formal features of the communicative system are. Yet unlike spoken 
language, many facial expressions, body movements, and vocal intonations used to 
express particular emotions are indeed identical between cultures that have been 
separated from one another for thousands of years, presumably because the fixed 
neuromuscular patterns that are involved. But aside from these instances of 
emotional expression, much of nonverbal communication is quite culture-specific, 
composed, according to Birdwhistell,” of a hierarchy of elements which can be 


compared to phonemes, words and sentences. 


In the present study we examined whether the ability to evaluate the 
emotional significance of paralinguistic cues might be associated with specific 
cortical regions. Subjects having well-defined patterns of brain damage, 
including either lateralized lesions or surgical commissurotomy, were given a 
standardized test in identifying facial expressions, body movements and — 
intonational qualities of the voice. The principal question was whether these 
abilities are well localized, as is the case for spoken language, or whether 
instead they are more diffusely represented in the brain. A priori, one might 
imagine that nonverbal communication could be closely allied in the brain to 
language, since paralinguistic cues accompany the verbal message and, like it, 
require the interpretation of discrete symbols. Alternatively, it might be 
anticipated that nonverbal communication might be more a function of the right 
cerebral hemisphere, since it is that side of the brain which is dominant for 
such functions as distinguishing faces, apprehending spatial relations, 
processing certain features of music, and perhaps even responding appropriately 
to emotional situations.*¢ Another question was whether the various aspects of 
nonverbal sensitivity were dissociable from one another, i.e., whether each 
represents a discrete function unto itself, and further what other cognitive 


faculties these abilities might be related to. 
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Subjects oo . 


The 11 subjects used in the first set of studies had predomi- 
nantly unilateral brain lesions which had been verified radiog- 
raphically (10 by CT scan and one by angiography): EEG data 
were also available in several cases. Table 1 summarizes the 
neurological and behavioral data on these subiects, obtained by . 
staff members of the Beth israel and Boston Veterans Adminis- 
tration Hospitals. | | 
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The PONS Test 


The test used for these studies, the Profile of Nonverbal Sen- | 
sitivity (PONS), was developed by Professor Robert Rosenthal : 
and his colleagues in the Department of Psychology, Harvarc 
University.43 The PONS is a standardized scale designed to 
assess competence in interpreting various types of emotional 
scenes presented through facial expressions, body movements 
and intonational qualities of the voice. The test has beer: admin- 
istered to several thousand people in this country and elsewhere, 
provicing extensive normative data against which the perfor- 
mance of our neurological subjects could be compared. | 

The PONS consists of a 16 mm black-and-white tilm con- 
taining 220 items to be discriminated. Each item runs for two 
seconds and portrays one of 20 difierent scenes presented 
through one or more channels of nonverbal communica- _ 
tion. The 20 scenes used in the PONS test were portray- 
young woman and vary in emotional tone along two dimen 
sions, positive-negative and dominant-submissive. : 


Fach of the scenes is presented in ll dif- 

ferent ways, varying according to the channels of information 
available. Five of these contain only “pure” visual or “pure” 
audio information: (1) face alone, no voice: (2) body from neck 
to knees, no voice; (3) face plus body, no voice; (4) random- 
spliced (RS) speech, no picture; (5) electronicaiiv filtered speech 
(called CF, or content filtered). The remaining six modes repre- 
sent combinations of these: (6) face plus random-spliced speech; 
(7) face plus content-filered speech; (8) body + RS; (9) body 
+ CE: (10) full figure + RS; and (21) full figure + CF. Items 
depicting various emotional scenes through different channels 
eppear in random sequence on the test. | 





To prepare the random-spliced speech, the two-second audio 
tape was cut into small segments and randomly reassembled. 
When played back, tonal qualities of the voice are retained but 
the sequence of individual sounds is disrupted. In content- 
filtered speech, selected bands of frequencies are removed and 
the audio signal is clipped. Althe::h the voice sounds muffled 
and unintelligible, the intonation, rhythm, tempo and loudness 
of speech. are preserved. In a sense, the random-spliced speech 
and thé content-filtered speech can be viewed as being some- 
what complementary. The random-spliced speech retains tone 
and timbre but degrades the rhythm, while the content-filtered 
speech loses the tonal qualities of the voice but retains the 
rhythm or sequence. | 
After ascertaining that the oral instructions for the test were 
understood, visual functioning was demonstrated by having 
subjects read the film credits on the screen and, intermittently 
during the test, asking them to describe the actress's poses. For 
the test items, the viewer selects one of two alternative choices 
which best describes the scene presented. These two choices — 
the correct one and a randomly selected incorrect one — nor- | 
mally appear on an answer sheet. However, since many of the 
neurological subjects were either dyslexic, hemianopic, or suf- 
fered hemifield neglect, the choices were read aloud to them 
before the scenes appeared. When |requested to do so by the sub- 
jects, the choices were again repeated after the scenes, though 
this was kept to a minimum to avoid possible cueing by the __ 
experimenter’s voice intonation. General alertness and attention 
to the test were monitored throughout. The strongest assurance 
of adequate comprehension and response set, however, was the 
observation that each subject was able to obtain normal scores 
on one or more portions of the test. | 


Data _ _ 
Test results are reported in terms of percentile rankings, ob- 
tained by comparing subjects’ raw scores with the published 
normative data.!4 On the various channels of nonverbal com- 
munication, data are pooled together to increase the size of the 
item samples. Thus, for the first channel presented ir. Table 2,_ 
“Audio only,” the score for the 20 items in which CF speech was 
presented without any visua! information plus the score for the 
20 items in which RS was presented without any visual informa- 
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tion are pooled together. Each of the next two columns, RS and | 
CE combines the score for the 20 items in which the audia 
channel was presented alone plus the 60 in which it was com- ! 
bined with either the face, boay, or whole figure. On the visual : 
items, “Face” includes the 20 items in which the face was shown | 
alone plus the 40 items in which it appearcd together with KS or | ! 
CF speech. “Body” and “Figure” are similarly derived. “Vics : 
only” shows the score for the 40 items in which the face, body, 

and full figure were presented without any audio information. 

The right side of Tabie 2 presents subjects’ performance ana- 

lyzed bythe type of scene: scores are based upon the 55 items 

for each emotional quadrant (le, positive-submissive, positive- 

dominant, negative-submissive and negative-dominant). 


Results 


Several of the most interesting cases will first be presented 
individually; general comments about the overall performance 
of right- vs. left-brain-damaged subjects Follow. 


A. Right-Brain-Damiaged Subiects | 
R1. This 56-year-old man suffered a stroke of the right mid- 
die cerebral artery six months prior to testing, which resulted in 
an infarct of the right temporal and inferior parietal areas. He 
had previously held a puysition of considerable responsibility in a 
large company, while aiso finding time to read several books a_ 
reek, After the stroke, R1 was no ‘onger able to get the gist of 
what he was reading, but described this simply as a “vision 
probiem.” Subsequent tests showed his acuity to be normal, 
although a left inferior quadrantanopia and some left visual 
field neglect were noted. Deficits were found in color-naming, 
‘udgment of distances, and object recognition. A striking per- 
sonality change was also noted: his formerly reserved, gentle- 
manly demeanor Ccisappeared and he became quarreisome, joked 
continuously, often about sexual subjects, and was noted as 
acting inappropriately familar with staff members. Language 
usage remained rich; his posttraumatic verbal 1Q was 135, per- 
formance 102. | | 
On the PONS test, R1’s overall score fell three standard 

deviations below norma!. Performance was particularly im- 
rairca on the items involving facial expressions, anu when only 








the face was shown he scored randomly. In striking contrast, ne 
was normal on items requiring judgment t of body gestures alone. 
An extraordinary feeture of this man’s performance was that, 
despite his inability to evaluate facial items, the face neverthe- | 
less a appears to have remained m agnetic to him and stowed in the 
way of his making use of other cues whenever it was present. If 
we consider the test items in which the face was absent (ie, 
body alone, tone-only items, BO + CF speech, etc.), this sub- 
ject actually scored luirty well, perfor: ning only 0.83 standard 
deviation below normal; however, when the face was added on 


to these _ channels his performance fell another two 


standard deviations. 

On audio items, Ki was 3.2 standarc deviations below nor- 
mal on items containing random-spliced speech alone, but only 
1.6 standard deviations below normal for content-filtered items. 
When his performance was analyzed across the different types 


of scene, a very skewed profile appeared: while he was only one 


standard deviation below average in recognizing dominant 
items, particularly negative-dominant ones (eg, expressing 

anger), he was praciically incapable of properly icentitying 
positive-submissive items (eg, asking torgiveness). 

R5. This 59-year-old man suffered two strokes five and eight 
years ago: CT scans reveal focal atrophy in the right parietal 
area, along with some dilatation of the right lateral ventricle 
and temporal horn. Continuing seizure activity in the right 
hemisphere was revealed by an EEG. Formerly a factory owner 
and manager of two restaurants, R5 lost much of his drive after 
the two strokes. However, he remains articulate and 
continues to speak three languages fluently. He is 
very sociable, humorous, and warn. 

Striking visuospatial deficits are apparent: though he can 
copy figures well, he has poor memory for designs and i is highty 
disoriented spatially. He has little ability to remember taces; he 
reports having spoken to people for hours, then having no 
memory of them or of the conversation the next day. A left 
hemifield inattention was noted in the neurological exam. 

On the PONS test,-R5’s overall performance was a little over 
one standard deviation below normal. Unlike R1, his ability 
to identify facial expressions was fully intact. He scored fe 
well on items showing the body only, and was extre: meiy poor 
in judwing intonatie: na qualities of the voice (an ems that 


ert 
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included the 
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voice only, he scored at a nearly chance level). Across the 
various types of emotional scenes, he showed a skewed 
performance profile reminiscent of R1’s. RS was 
adept in identifying negative-dominant items, but was poor in 
evaluating positive emotional scenes. 

R6. Ten months previously, this 71-year-old man suffered 
two massive strokes in distribution of the right middle cerebral 
artery, resulting in a severe atrophy of the temporoparietal area. 
A sense left hemiplegia and hemaesthesia remain, asdoesa 
neglect of the left visual field. Tnis eminent surgeon had been 
admitted to coliege in his youth on the basis of having one of 
the highest Stanford-Binet scores in the country. His WAIS ver- 
bal IQ remains 148 after the stroke, although his performance 
score is downto 89. Writing and reading remain intact, 
although inccasequential words in the left hemifield are 
occasionally omitted. Language usage, especially in describing 
remote events, is rich in detail and humor, though producec in 
a somewhat deadpan, monotonous manner. Digit span and sim- 
ple arithmetic are normal. However, verbal abstraction is poor. 
Performance on block design, picture arrangement, object 
assembly and digit symbo! tasks are ail severely compromised, 
as are copying and drawing from memory. A left hemineglect is 
dramatic, although this is more marked for designs than for 
reading words. Recognition of famous faces is somewhat im- 
paired, but faces on the ward are recognized. Facial mimicry Is 
poor. Singing is monotonous with rhythm preserved. The sub- 
iect has been incontinent and has occasionally been seen ex- 
posed on the ward. He is = unaware of his visuospatial 
and other cognitive problems. 

R7 was only able to complete half of the PONS test, and con- 
secuiently the scores reported in Table 2 represent extrapolations 
which are somewhat less statistica!ly reliable than for the other 
cases. Overall performance was 3.5 standard deviations below 
the norm (0.02° percentile), with the deficit being greater for 
video than for audio channels. Across the various types of 
scenes, identification of positive-dominant items was just outside 
the normal range; in contrast, negative-dominant items, nor- 
mally the most salient on the test, were barcly recognized at all. 


B. Subjects with Damage to the Left Hemisphere 
Li: This formerly right-handed, 27-year-old man suffered an 
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occlusion of the left carotid artery at the age of six which 
resulted in a dense right hemiplegia and a severe language 

deficit. The right side remains spastic and atrophic, and the sub- 
ject now relies upon his left arm. However, no right hemianopia 
or loss of sensation are observed. The subject reads at a grade 4 
level, writes at a primer level, : ‘isspelis the simplest words and 
cannct do simple arithmetic operations. Vocabulary is ata 
grade 6 level. Grammar is somewhat restricted but correct. 
Some difficulty in word-finding and in pronunciation remain. 
Prosody is good. Moderate to severe deficits are seen on tests Or 
motor organization and sequencing. Constructional ability and 
recall of complex figures are good. WAIS verbal IQ is 100, per- 
formance 103. Dilantin and pentobarbito: are taken to con- 
tro! seizures. | : 

The subject’s overall performance on the PONS test was slight- 
ly above average. Excellent scores were obtained on video items, 
particularly those involving the face. Performance for items with 
audio information only was considerably inferior, although all 
scores fel] within one standard deviation of the mean. For the 
different types of scenes, the nevative and submissive items were 
perceived exceptionally weil, the others within the normal range. 

L4, a 49-year-old right-handed man, suffered an aneurism of 
the left internal! carotid with a cerebrovase..:ar infarct in distriou- 
tion of the left middle cerebral artery two years ago. Shortly 
after the strok~, speech was fluent but empty of content. The 
subject could follow orders but could not point to objects or 
repeat even single words or numbers. Comprehension has im- 
proved markedly, although a few words are still missed. Speech is 

halting, contains paraphasias| of phonetically or semantically 
related words, along with circumlocutions, agrammatisms, and 
some neologisms. Intonation of speech is good. Visuospatial and 
constructional abilities are unimpaired. Performance 1Q on the 
WAIS is 144, and even shortly after the stroke, the subject scored 
in the 95° percentile on the Raven's progressive matrices test. 

Overall performance on the PONS test was just below average 
(38th percentile), and-scores on all items fell within +1 standarc 
deviation of the norm. Across the various types of scenes, scores 
range from the upper quartile for recognitior. of the negative- 
dominant scenes to the lower guartile for both positive-dominant 
and negative-submissive items. 


C. General Comparison of 


Right- and 


Left-Brain-Damaged Groups ; 

- The left- and right-hemisphere groups both comprise hetero- 
geneous popuations, net only in terms of the subjects’ age, Sex, 
background, and native intelligence, but also in terms of the 
specific loci of damage within the hemisphere. Nevertheless, cer- 
tain between-group differences stand cut markedly. In 
overall scores, the subjects with right-sided damage averaged 
4.86 £0.40 standard deviations below the mean, the subjects 
with. left-sided damage 0.48 + 0.33 standard deviation below; 
these differ at a level of 0.05 > p > 0.01 (2-tailed). Comparing 
the two groups’ performance on the various channels, the sub- 
jects with right-sided damage were significantly poorer in inter- 
preting random-spliced speech (p ~ 02), and, most strikingly, 
facial expressions (p ~ 0.01). Nio reliable between-group difter- 
ences were found for recognition of body expressions (p ~ 0.15), 
content-filtered speech (p ~ 0.25) or tone only, 


Differences between the 


two groups were marginaily significant for items involving the 
whole figure (p ~ 0.08) and video alone (p ~ 0.07), effects very 
likely attributable tc the ‘~clusion of facial expressions in both of 


these categories. 


The sccring profiles of the two groups suggest a complemen- 
tarity in their patterns of deficits. On visual items, subjects nav- 


ing right hemisphere damage did relatively better in discerning 


emotions from the body gestures than from the face; with audio 
input, they were relatively better with content-filtered than with 
random-spliced speech. The data from the left-hemisphere sub- 
jects suggest just the opposite pattern: better performance of 
stems of facial expression than for body gestures, and higher 


scores for RS vs CF speech. 


In comparison with the subjects 


having left-sided damage, the right hernisphere group's relative 


impairment in discerning fa 
tures is significant at a p va 


information the relative impairmeni } 


soliced more than content-f 
0.07 level (2-tailed). 


cial emotions more than body ges- 

luc of 0.08 (2-tailed), and for audio 
in interpreting random- 

iltered speccn 1s reliable at the p = 


Thile most individuals in both groups tended to show highly 
skewed profiles across the different types of emotional scenes, no 
overai! between-group differences stood out when scores were 


pouled, 


weet 
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D. Studies in "Split-Brain" Subjects 


Working in the laboratory of Dr. R.W. Sperry at Cal Tech, we administered the 
PONS test to several "split-brain" patients, people whose two cerebral 
hemispheres function in isolation from one another following surgical resection 
of the tencephalic commissures./“ Studies in these subjects have of course 
already provided us with invaluable information about the contributions of the 
two hemispheres in many cognitive domains, and we felt that these people would 


allow us an extraordinary opportunity to further examine the cerebral 


lateralization of nonverbal communication. | | 
In these subjects we used a shorter version of the PONS containing 80 items: a 


film showing the 20 "face only" items and the 20 with body alone; and an audio 


tape which presented the 20 RS and.20 CF speech items. 


Very dramatic results were obtained from subject LB, a 
24-year-old right-handed man who had been commissurotomized 
at the age of 13 for intractable epilepsy. His WAIS verbal IQ is 
110, performance 100. On visual items of the PONS test, each 
hemisphere was tested separately using the newly developed 
“Z-lens.1 This system is composed of a collimator attached to a 
contact lens. By covering one eye and occluding either the nasa! 
or the temporal half of the collimator, complex visuai: stimuli can 
be presented over long periods of time to only one hen misphere, 
an advance which for the first time allows the limits of cam- 
petence of each side of the brain to be studied’in isolation. The 
ri-kt hemisphere was tested first so that any practice effects, 
though unanticipated, would be to the advantage of the left 
hemisphere. To cbtain the response of the mute right hemi- 
sphere, the subject was asked to use left hand signals to indicate 
which of the two choices read to him he preferred. On video 
portions of the PONS test, LB’s right hemisphere scored perfectly 
normally on the items showing facial expressions (ie, in the 50° 
percentile), but only at the 5° percentile level for body move- 
ments. The isolated left hemisphere Showed just 


the reverse pattern: ising veroal responses to indi- 
cate his : choices, LB now scored in the 26° 
percentile for body movemenis but only a: the 4 


percentile level on facial expressions. 


Since audio information presented to either ear gets projected. 
to both cerebral hemispheres, it was not possible to lateralize the 
vocal | items of the PONS test. We nevertheless at- 
tempted to assess each hemisphere’s performance, either by hav- 
ing the contralateral hand use finger signals to indicate 
which choice |was preferred, or insome cases, by allowing 
the hand to ‘select by touch a plastic number 1 or 2 | 
from an array of six plastic numbers. With this method, subject 
LB scored very well on both RS and CF items using either his left 
hand or a verbal response to indicate his choice. 7 

In three other split-brain subjects wno were studied, it was not 
possible to lateralize the video portion of the test (contact lenses 
have not been made to fit two of these subjects, and a third who 
does have a lens was completely inattentive when the right hemi- 
sphere was tested). Viewing the test in free vision and making 
verbal responses which presumably reflect the choices of the left 
hemisphere, two of the three scored equally poorly on both face 
and body; the third subject scored normally on body movement 
‘tems but in the bottom percentile on facial expressions. On 
audio items, one subject showed a striking superiority for CF 
speech over RS, while the other two did not show much of a ail- 
ference between RS and CF when giving verbal answers. 

Another remarkable subject tested at Cal Tech was DW, a 
20-year-old man who underwent a right hemispherectomy 

at the age of eight. His WISC verbal IQ has been 
measured as 80, performance 60. . 
On the PONS test, he scored at a purely chance level on facial 
expressions, but in the 26° percentile on body movements. On 
audio portions of the test, DW scored in the 82° percentile 
on content-filtered speech items, but only in the 16° percentile 
for RS speech. Since this subject only possesses a left hemispnere, 
these results are quite unambiguous with respect to which side is 
controlling the response. 


Discussion 


The first conclusion to be drawn from these results is _ 
thal sensitivity to nonverbal communication is larcely dissociated 
in the brain from verbal abilities, the two domains." . iially re- 
cuiring opposite hemispheres. This dissociation is particularly 
evident in right-brain-damaged subjects M1 and R7. Both of trese 


men scored nearly three standard deviations below normal on 


‘the PONS test, but retained posttraumtic verbal IQ’s more than 


ex 


hemi-— 
Sphere. 


two standard deviations above normal. In contrast, subject L1, 
whose extensive left heriisphere damage early in life left him 
with a number of severe language-related problems, scored 
above average on the test. It might be noted that despite the rela- 
tively small population tested here and the variability among the 
sites of damage, the performance difference between the right 
and left hemisphere groups nevertheless achieved statistical 
ienificance, a testimony to just how clear a right hemisphere 
furction overall sensitivity to nonverbal communication is. 
Facial expressions normally convey the greatest amount of in- 
formation in nonverbal communication!®!7.18 and it is their 
inability to evaluate these signals which presents the 
greatest problem for most of the right-brain-damaged subjects. 
Five our of seven patients in this eroup 
scored in the 4° percentile or below on items showing facial 
pressions alone. 


The right hemispherectomy patient also scored at a chance level 
on these items, while the split-brain subjects tested with their left 
hemisphere did only slightly better. Converscly, the one split- 
brain subject who was tested with his right hemisphere alone per- 
formed quite well on facial expressions, as did all of the 
urological subjecis.-having left-sided lesions but an intact right 
hemisphere. Thus, all of the data indicate that it is the percep- 
tion of facial expressions which is particularly lateralized to the 
right hemisphere. In the right hemispherectomy patient, the per- 
sistent inability to evaluate facial emotions despite the passage of 


12 years since surgery would further suggest that_the left 


may possess little potential to acquire facial emotional recogni- 
tion. Further support for this thesis would require studies in cases 
where right hemispherectomy had been done even earl ier than 
age eight. : 

A superiority of the right hemisphere in the recognition of dif- 
ferent faces is well established??? involving in particular the 
right occipitotempora! region,“!-42 and for learning new faces, the 
hippocampal and parietal areas as well.*4.74--9 Prosopaganosia, a 
relatively pure inability to recognize faces but not other :amillar 

visual objects, has been associated with lesians of the rig ht occin- 
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itefemporal area (lingual and/or fusiform gyri), combined with | 
damage to related (usually homologous) structures on the left | ) 
side of the brain.*° _ | | | 
In the present group of subjects, the region that appeared to be | 
the most critical for identifying facial emotions may be 
somewhat coextensive with that involved in facial recognition: a 
comparison of the lesion sites for subjects who clid relatively well 
or poorly in judging facial expressions would suggest that it may 
be the right temporal arca that is particularly important for 
“reading the face.” This raises the question of whether the deficit 
reported here may not be part of a gencral prosopagnosia. How- 
ever, among the subjects who scored poorly in evaluating facial 
emotions, all but one were clinically unimpaired in distinguishing 
faces; conversely, the one right-brain-damaged subject who did 
well in recognizing facia! expressions (R5) reported great dif- 
ficulties in remembering new faces. Differential impairments in 
physiognomic vs emotional recognition of faces have also recent- 
lv been reported in anoiher study of right-brain-damaged sub- 
jects.27 
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And in normal subjects, studies using tachisto- 
scopically presented faces suggest that the per- 
ception of facial emotions is more strongly lateral- 
ized as a right hemispheric function than is the 
ability to identify individual faces. Several 
earlier studies had shown that faces presented 
tachistoscopically to the left visual field (i.e., 
directly to the right hemisphere) are recognized somewhat faster 
_ than when presented to the right visual field, although this dif- 
ference is minimal for familiar faces.28.29.30 When the task is to 
recognize emotions in the face, however, the superiority of the 
right hemisphere becomes considerably more pronounced. For | 
faciai emotions, the reaction time difference for the right vs the 
left hemisphere is twice that obtained when the faces are : 
nonemotional,*? and another study reported that the right hersisphere's 
Superiority over the left increases systematically with the intensity 
of the emotions depicted.3* Also, in split-brain subjects, Levy et al20 
have shown that while the right hemisphere is superior to the left 
in distinguishing different faces, the left side is quite competent 
as well, particulariy when readily nameable features are available 
(eg, glasses or a moustache). In contrast, the present studies, 
some of which were done in the same split-brain subjects, in- 
dicate practically no left hemispheric ability at all-for recognizing 
facial emotions. | | 


In contrast to facial expressions, the evaluation of body move- 
ments does not appear to be Jateralized as a right hemispheric 
Function. Four of the right-brain-damayed subjects scored at least 
1.5 standard deviations higher in judging body movements than 
facial expressions, and in the split-brain and hemispherectomy 
subjects, the left hemisphere showed a far greater ability in judg- 
ing body movements than facial emotions. Conversely, in the 
one instance where the right hemisphere was tested alone, it- 
did much poorer with the body than with the face. At this coint, 
the basis for a differential lateralization in judging facial expres- 
sions and body movements can only be a matter of speculation. 
Perhaps it is because the body movements are more conven- 
tionalized sequences of specific symbols in time, and thus more 
the metier of the left hemisphere. Other studies have shown that 
losses of gestural and pantomimic abilities are associated mare 
with left than with right hemisphere damage,33 as are deficits in 
nterpreting gestures.34 The perception of emotion-specific body 
movements seems not to have been explored as thoroughly, 
although it might be noted that losses in overt emotional expres- 
sion have been linked with right parietal damage.35 

On the audio items of the PONS test, the patterns of im- 
pairments shown by our subjects suggest the possibility that two 
distinctive qualities in the voice may be processed differentially 
in the two hemispheres. That is, the right hemisphere may be 
relatively more concerned with processing timbre and tonal con- 
trasts of the voice (which are retained in RS speech), whereas 
timing or rhythmic qualities (which are preserved in CF items) 
may depend more upon the left side of the brain. Such a dichot- 
omy would be consistent with the observation that in music, 
discrimination of tone and timbre are more sensitive to right than 
to left temporal lobectomy, *° while rhythm appears to be better 
represenied on the ieft side of the srain.37 It should be empha- 
sized, however, that counterexamples to this dichotomy can be 
found among the present group of subjects: eg, several right- 
brain-damaged subjects scored as poorly on CF items as on RS, 
Wire One subject with a right temporal AVM scored very well or 
both RS and CF speech. Thus, any conclusions reached about the 
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_ Considering the importance of nonverbal communication for 
such things as mother-infant interactions, establishment of social 
hierarchies, minimization of physical conflict, and group 
coherence, it does not seem unreasonable to imagine that specific 
neural determinants have evolved to specify competence in this 
do-nain. In certain neurological patients, particularly those suf- 
fering lesions of the right hemisphere, damage to these centers 

could lead to major perceptual and behavioral limitations and 
may be related to the crippling interpersonal and emotional 
changes which have often been described after such brain 
damage.°° It woula seem that the routine inclusion of tests for 
nonverbal sensitivity in the neurological examination might help 
bring to light important dysfunctions, while also contributing to 
our general understanding of brain-behavior relations. 


Note: This work was done in collaboration with David Bear, M.D. (Department of 
Psychiatry, Harvard Medical School and Behavioral Neurology Unis. Beth Israel 
Hospital); Marsel-M. Mesulam, M.D. (Department of Neurology. Harvard Mecca! 
School and Beth Israel Hospital); Robert Rosenthal, Ph.D. (Deparment: of Psychology. 
Harvard University); Eran Zaidel, Ph.D. (Department of Biology, California Institute of 
Technology); and Roger W. Sperry, Ph.D. (California Institute of Techrvlogy). The 
research was supported by a Sloan Foundation Fellowship to the autnor. 

| also wish to thank Dr. 5. Weintraub and Ms. Robin Baraty (Behavioral Neurology 
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